Image processing apparatus and method and storage medium storing program

ABSTRACT

An image processing apparatus which outputs an index print of information representing a plurality of pictures having picture size of different aspect ratios, with each of the plurality of pictures being respectively assigned a number in numerical order. The image processing apparatus detects size information for each of the plurality of pictures based on the respective aspect ratios, and a picture output order different from the numerical order is determined based on the detected size information for each of the plurality of pictures.

BACKGROUND OF THE INVENTION

[0001] 1. Field of the Invention

[0002] The present invention relates to an image processing apparatusfor realizing a photographic printer (or photoprinter) that is adaptedto produce an index print of information representing a plurality ofimages inputted from an image input device, for example, a digitalcamera, on, for instance, a single sheet of printing paper.

[0003] 2. Description of the Related Art

[0004] In recent years, digital cameras have come into wide use. As asimple means for printing and outputting pictures taken by digitalcameras, there have been proposed photoprinters adapted so that imagedata is inputted thereto by connecting digital cameras directly theretoor by setting a storage medium, which stores image data representingpictures taken by digital cameras. Further, some of these proposedphotoprinters include the function of forming an index print of imagedata, which are stored in a digital camera connected thereto or in astorage medium set therein, on, for example, a sheet of printing paperso that pictures represented by the image data are printed thereon in asmall size. Such an index print permits users to check a plurality ofimages at a time, and facilitates selection of one of the pictures.

[0005] However, in the case of using such conventional photoprinters,the order in which pictures are printed on an index print sheet dependson numbers respectively assigned to the pictures in a digital camera ora storage medium, and is, for instance, a photographing order. Thus, theconventional photoprinters have the following drawbacks.

[0006] Namely, in the case of producing an index print which is a singleprint composed of a plurality of pictures of print sizes of differentaspect ratios, such as a normal size and a panorama size, when thesepictures are arranged and printed in the order of the aforementionednumber assigned to each thereof, a result of producing the index printis obtained as illustrated in FIG. 6. Namely, 4 pictures, whose printsizes are a normal size or a panorama size, are arranged on each line orrow. Incidentally, a number assigned to each of the pictures is apicture number. Among these pictures, the print size of pictures Nos.4′, 10′, 13′ and 15′ is the panorama size. However, as is seen from theresultant index print illustrated in FIG. 6, the conventionalphotoprinter produces an index print which excels in the indexingability but has a defect in that pictures of a panorama size are smalland are difficult to view.

[0007] Turning to FIG. 7, there is shown an index print produced byenlarging a picture of a panorama size so that the longitudinaldimension of the panorama size is equal to the longitudinal dimension ofa normal size. Although pictures of the panorama size in this case areeasy to view, only one picture of the panorama size can be placed on arow. Thus, a line feed (operation) is forcibly performed each time apicture of the panorama size is printed. This results in a largewasteful or useless space on a sheet of printing paper. Thus theappearance of the index print is poor. Moreover, printing paper iswasted.

[0008] The present invention is directed to eliminating theaforementioned drawbacks of the conventional photoprinter.

SUMMARY OF THE INVENTION

[0009] Accordingly, an object of the present invention is to provide animage processing apparatus for obtaining an index print which excels inthe indexing ability and looks attractive without making wasteful space,in an image editing system for layout of a plurality of images ofdifferent sizes.

[0010] To achieve the foregoing object, in accordance with the presentinvention, there is provided an image processing apparatus foroutputting an index print of information representing a plurality ofimages, which comprises: input means for inputting the plurality ofimages to which numbers are respectively assigned; means for detectingsize information on image sizes of the plurality of images; decisionmeans for determining an outputting order, which is different from anumerical order determined by the numbers respectively assigned to theplurality of images, according to the size information on image sizes ofthe plurality of images; and output means for outputting the pluralityof images according to the outputting order.

[0011] Other features, objects and advantages of the present inventionwill become apparent from the following description of preferredembodiments with reference to the drawings in which like referencecharacters designate like or corresponding parts throughout severalviews.

BRIEF DESCRIPTION OF THE DRAWINGS

[0012]FIG. 1 is a diagram showing a result of producing an index printin a first embodiment of the present invention;

[0013]FIG. 2 is a diagram illustrating the hardware configuration of thefirst embodiment of the present invention;

[0014]FIG. 3 is a flowchart illustrating an operation of a photoprinterof the first embodiment of the present invention;

[0015]FIG. 4 is a diagram showing a result of producing an index printin a second embodiment of the present invention;

[0016]FIG. 5 is a flowchart illustrating an operation of a photoprinterof the second embodiment of the present invention;

[0017]FIG. 6 is a diagram illustrating a first example of a result ofproducing an index print by a conventional photoprinter; and

[0018]FIG. 7 is a diagram illustrating a second example of a result ofproducing an index print by a conventional photoprinter.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Hereinafter, the preferred embodiments of the present inventionare described in detail by referring to the accompanying drawings.

[0020] First Embodiment

[0021] Hereunder, a first embodiment of the present invention isdescribed. In this embodiment, image data, which represent picturestaken by a digital camera and are stored in an internal memory of theaforesaid digital camera, and are read therefrom. Then, the order inwhich the pictures are arranged according to the sizes of the picturesis changed. Subsequently, an index print of the image data is producedas illustrated in FIG. 1. Namely, as shown in FIG. 1, only pictures of anormal size are printed in a first or former half of the index print insuch a way that four such pictures are printed on each row or linethereof. Further, only pictures of a panorama size are printed in asecond or latter half of the index print in such a manner that one suchpicture is printed on each row.

[0022]FIG. 2 is a diagram illustrating the hardware configuration of thefirst embodiment of the present invention.

[0023] In FIG. 2, reference numeral 10 designates a digital camera thatcomprises: a camera portion 11 which converts a picture taken through alens (not shown) into an electrical signal by means of a photoelectricconversion element or device or the like, and stores image datarepresenting the taken picture, together with attribute informationindicating a corresponding picture number and a picture size thereof;and an interface portion 12 which reads the image data and the attributeinformation from the camera portion 11 in accordance with a commandtransmitted from a photoprinter (to be described later). Further, aninterface cable 30 connects the digital camera 10 with a photoprinter20.

[0024] The photoprinter 20 consists of a control portion 21, a buffermemory 22 and a recording portion 23 which prints image data on arecording medium, namely, printing paper by employing, for example, anink jet method. The control portion 21 composed of CPU 211 and ROM 212issues various commands to the digital camera 10 and causes the buffermemory 22 to store input image data and to output image data to therecording portion 23 correspondingly to rows or lines of an index print,respectively. Incidentally, in the case of this embodiment, image datarepresenting four pictures of the normal size are outputtedcorresponding to each line of the first half of an index print, whileimage data representing a single picture of the panorama size isoutputted corresponding to each line of the second half thereof. It isassumed that these operations of the control portion 21 are performed inaccordance with a program stored in ROM 212.

[0025] Next, an operation of the control portion 21 of the photoprinter20 in the case of producing an index print is described in detailhereinbelow with reference to the flowchart of FIG. 3.

[0026] First, in step S1, the initial values of variables x and n areset at 0 and 1, respectively. Incidentally, the variable x indicates thenumber of pictures of the normal or standard size stored in the buffermemory 22 in such a manner as to be laid on a row or line of interest ofthe printing paper, and the maximum value of the variable x is 4.Further, the variable n designates the image No. of an image or pictureof interest, which is represented by image data now inputted from thedigital camera 10.

[0027] Subsequently, in step S2, the control portion 21 requests thedigital camera 10 through the interface cable 30 to send the attributeinformation, such as size information on the size of an image No. n,namely, information representing what is called the size ratio of thenormal or standard size or the panorama size. Then, in step S3, it isjudged whether or not detected attribute information is a codeindicating an end of image data. If so, the control portion 21 advancesto step S11. In contrast, if not, the control portion 21 proceeds tostep S4.

[0028] In step S4, the control portion 21 judges from detected attributeinformation which of the normal size and the panorama size the size ofthe image of interest, namely, the image No. n is. If the image ofinterest is of the panorama size, the control portion 21 advances tostep S10 whereupon the variable n is updated by being changed into(n+1). Then, the control portion 21 returns to step S2. Namely, thus, inthe case that the image of interest is of the panorama size, the controlportion 21 bypasses this image and changes an image of interest to thenext image by incrementing the variable n. In contrast, if it is judgedin step S4 that the image of interest is of the normal size, the controlportion 21 advances to step S5.

[0029] In step S5, the control portion 21 requests the digital camera 10to send image data representing the (current) image No. n, and furtherstores the inputted image data representing this image No. n in thebuffer memory 22. Subsequently, the control portion 21 goes forward tostep S6 whereupon the variable x is updated by being changed into (x+1).Then, the control portion 21 advances to step S7.

[0030] In step S7, it is judged whether or not the variable x hasreached 4. If not, the control portion 21 proceeds to step S10 whereuponthe variable n is updated by being changed into (n+1). Then, the controlportion 21 returns to step S2. In contrast, if it is found in step S7that X=4, the control portion 21 goes forward to step S8.

[0031] In step 8, the variable x is reset to 0. Then, the controlportion 21 advances to step S9 whereupon image data corresponding tofour images of the normal size, which are stored in the buffer memory22, are read therefrom and these four images are printed on a line orrow. Subsequently, the control portion 21 goes forward to step S10whereupon the variable n is updated by being changed into (n+1). Then,the control portion 21 goes back to step S2.

[0032] In the aforementioned process of repeating steps S2 to S10, if acode indicating an end of image data is detected or recognized, thecontrol portion 21 advances to step S11. If there are image datarepresenting pictures, which are not printed yet but are stored in thebuffer memory 22, in step S11, such pictures, the number of which is notmore than 4, of the normal size are printed on a line. Thus, theprinting of all of the pictures of the normal size is completed.

[0033] Thence, the control portion 21 initiates and performs a processof printing pictures of the panorama size. Namely, the control portion21 starts changing a picture of interest from a first one of thepictures of the panorama size in sequence. Further, only the pictures ofthe panorama size are printed in such a way that each such picture isprinted on every row.

[0034] First, in step S12, the initial value of the variable n is setat 1. Then, the control portion 21 advances to step S13.

[0035] In this step S13, the control portion 21 requests the digitalcamera 10 through the interface cable 30 to send the attributeinformation, such as size information on the size of an image No. n,namely, information representing the size ratio of the normal orstandard size or the panorama size. Then, in step S14, it is judgedwhether or not detected attribute information is a code indicating anend of image data. If so, the control portion 21 finishes performingthis process illustrated in this flowchart. In contrast, if not, thecontrol portion 21 proceeds to step S15.

[0036] In this step S15, the control portion 21 judges from detectedattribute information which of the normal size and the panorama size thesize of the image of interest, namely, the image No. n is. If the imageof interest is of the normal size, the control portion 21 proceeds tostep S18 whereupon the variable n is updated by being changed into(n+1). Then, the control portion 21 goes back to step S13. Namely, thus,in the case that the image of interest is of the normal size, thecontrol portion 21 bypasses this image and changes an image of interestto the next image. In contrast, if it is judged in step S15 that theimage of interest is of the panorama size, the control portion 21proceeds to step S16.

[0037] In this step S16, the control portion 21 requests the digitalcamera 10 to send image data representing the (current) image No. n.Then, in step S17, the inputted image data representing the image of thepanorama size, namely, this image No. n is printed in such a manner thatthis single image is printed on a row or line. Subsequently, the controlportion 21 advances to step S18 whereupon the variable n is updated bybeing changed into (n+1). Then, the control portion 21 returns to stepS13.

[0038] In the aforesaid process of repeating steps S13 to S18, if a codeindicating an end of image data is detected or recognized in step S14,the entire operation of printing of all of the pictures is completed. Asa consequence of the herein-above described operation, a resultant printis obtained in a manner where the pictures are arranged in theoutputting order that is different from the order based on the numbersrespectively assigned to the pictures, as illustrated in FIG. 1.

[0039] Incidentally, the pictures of the panorama size and the picturesof the normal size can be placed in an upper part and a lower part ofthe printing paper, respectively, by replacing a process consisting ofsteps S1 to S11 of FIG. 3 with another process consisting of steps S12to S18 shown in the same figure.

[0040] Second Embodiment

[0041] Next, a second embodiment of the present invention is described.In this embodiment, image data, which represent pictures taken by adigital camera and are stored in an internal memory of the aforesaiddigital camera, are read therefrom. Then, the order in which thepictures are arranged according to the size of the pictures is changed.Subsequently, an index print of the image data is produced asillustrated in FIG. 4. Incidentally, as shown in FIG. 4, the picturesare printed without considerably changing the order in which thepictures are arranged, in such a way that four pictures of the normalsizes are printed on each row or line thereof and that one of picturesof the panorama size is printed in each row.

[0042] The hardware configuration of the second embodiment is similar tothat of the first embodiment, namely, to that illustrated in FIG. 2.

[0043] Next, an operation of the photoprinter 20 in the case ofproducing an index print is described in detail hereinbelow withreference to the flowchart of FIG. 5.

[0044] First, in step S21, the initial values of variables x, n and mare set at 0, 1 and 1, respectively. Incidentally, the variable xindicates the number of pictures of the normal or standard size, whichare stored in the memory in such a way as to be laid out on a row orline of interest on the printing paper, and the maximum value of thevariable x is 4. Further, the variables m and n designate the image No.of an image or picture of interest, which is of the normal size, and theimage No. of a picture of interest, which is of the panorama size,respectively.

[0045] Subsequently, in step S22, the control portion 21 requests thedigital camera 10 through the interface cable 30 to send the attributeinformation, such as size information on the size of an image No. n,namely, information representing the size ratio of the normal orstandard size or the panorama size. Then, in step S23, it is judgedwhether or not detected attribute information is a code indicating anend of image data. If so, the control portion 21 proceeds to step S37.In contrast, if not, the control portion 21 advances to step S24.

[0046] In this step S24, the control portion 21 judges from detectedattribute information which of the normal size and the panorama size thesize of the image of interest, namely, the image No. n is. If the imageof interest is of the panorama size, the control portion 21 goes forwardto step S36 whereupon the variable n is updated by being changed into(n+1). Then, the control portion 21 goes back to step S22. Namely, thus,in the case that the image of interest is of the panorama size, thecontrol portion 21 bypasses this image and changes an image of interestto the next image by incrementing the variable n. In contrast, if it isjudged in step S24 that the image of interest is of the normal size, thecontrol portion 21 proceeds to step S25.

[0047] In this step S25, the control portion 21 requests the digitalcamera 10 to send image data representing the (current) image No. n, andfurther stores the inputted image data representing this image No. n inthe buffer memory 22. Subsequently, the control portion 21 advances tostep S26 whereupon the variable x is updated by being changed into(x+1). Then, the control portion 21 goes forward to step S27.

[0048] In this step S27, it is judged whether or not the variable x hasreached 4. If not, the control portion 21 advances to step S36 whereuponthe variable n is updated by being changed into (n+1). Then, the controlportion 21 goes back to step S22. In contrast, if it is judged in stepS27 that X=4, the control portion 21 proceeds to step S28.

[0049] In this step 28, the variable x is reset to 0. Then, the controlportion 21 goes forward to step S29 whereupon image data correspondingto four images of the normal size, which are stored in the buffer memory22, are read therefrom and these four images are printed on a line orrow. Subsequently, the control portion 21 goes forward to step S30.

[0050] Next, in this step S30, the control portion 21 requests thedigital camera 10 through the interface cable 30 to send the attributeinformation, such as size information on the size of an image No. n,namely, information representing the size ratio of the normal orstandard size or the panorama size.

[0051] In step S31, it is judged from the attribute information which ofthe normal size and the panorama size the size of the image of interestis, namely, the size of image No. m. If the image of interest is of thenormal size, the control portion 21 advances to step S34 whereupon thevariable m is updated by being changed into (m+1). Then, the controlportion 21 proceeds to step S35. In this step S35, it is judged whetheror not the variable m reaches (n+1). If NO (N), the control portion 21returns to step S30. Conversely, if YES (Y), the control portion 21 goesback to step 36. In contrast, if it is judged in step S31 that thepicture of interest is of the panorama size, the control portion 21proceeds to step 32.

[0052] In this step S32, the control portion 21 requests the digitalcamera 10 to send image data representing the (current) image No. m.Then, in step S33, the inputted image data representing the image of thepanorama size, namely, this image No. m is printed in such a manner thatthis single image is printed on a row or line. Subsequently, the controlportion 21 proceeds to step S35 whereupon the variable m is updated bybeing changed into (m+1). In step S35, it is judged whether or not thevariable m reaches (n+1). If N, the control portion 21 returns to stepS30. In contrast, if Y, the control portion 21 returns to step S36.

[0053] In the aforesaid process of repeating steps S22 to S35, if a codeindicating an end of image data is detected or recognized in step S23,the control portion 21 advances to step S37.

[0054] If there are image data representing pictures, which are not yetprinted and are stored in the buffer memory 22, in step S37, suchpictures, the number of which is not more than 4, of the normal size areprinted on a line. Thus, the printing of all of the pictures of thenormal size is completed. As a consequence of the herein-above describedoperation, a resultant print is obtained in a manner where the picturesare arranged in the outputting order that is different from the orderbased on the numbers respectively assigned to the pictures, asillustrated in FIG. 4.

[0055] Other Embodiments

[0056] Further, image data inputted in steps S5 and S16 is accompaniedwith the image No. n of a picture represented by the inputted imagedata. When printing the image data in step S8 or S17, the image No. n isprinted in the neighborhood (for example, an upper part) of each of thepictures. Thus, the corresponding relation between the picture and theimage No. becomes quite obvious. Consequently, the selection of thepicture is further facilitated.

[0057] Moreover, in the foregoing description of the aforementionedfirst and second embodiments, each embodiment uses a digital camera asan image input device and directly connects the digital camera to thephotoprinter. However, the present invention can be applied to the casewhere image data is inputted to this image processing apparatus from astorage medium which stores digital image data. At that time, theapparatus may be provided with means for detecting size information onthe size of each picture in such a way as to automatically detect thesize information. Alternatively, the apparatus may be adapted so thatsize information is manually inputted by a user. Furthermore, concerningthe image Nos., the apparatus may be similarly adapted as the case ofdetecting size information.

[0058] Further, in the foregoing descriptions of the first and secondembodiments, there have been described the embodiments in each of whichthe photoprinter is used as the image output device. However, thepresent invention may be applied to the case that the pictures areoutputted in a manner in which the pictures are arranged on a virtualsheet to be displayed on the screen of a display device.

[0059] Moreover, in the foregoing descriptions of the first and secondembodiments, there have been described the embodiments in each of whichthe control portion is provided in the photoprinter. The apparatus,however, may be configured so that a general purpose personal computerperforms operations, which are similar to those performed by the controlportion 21, in accordance with a program stored in a removable storagemedium such as CD-ROM or a floppy disk.

[0060] Furthermore, in the foregoing descriptions of the first andsecond embodiments, there have been described embodiments that employ amixture of input pictures having two different size ratios, namely,input pictures of the normal size and the panorama size, which aredifferent in aspect ratio from each other. However, a plurality ofpictures having three kinds of different size ratios, for instance, aclassic size ratio (2:3) employed in a new system camera, an aspectratio (9:16) employed in a high definition television (HD-TV) system anda panorama aspect ratio (1:3), may be used as input pictures.Additionally, a plurality of pictures having more than three kinds ofdifferent size ratios (or aspect ratios) may be used as input pictures.In addition, the present invention can be applied to the case thatpictures having practically different aspect ratios are used even if thesize ratios thereof are equal to one another, for example, the case thatis called a longitudinally-oriented picture, namely, a landscape pictureis distinguished from what is called a transversely-oriented picture,namely, a portrait picture among pictures of a normal size.

[0061] As described above, in accordance with the present invention,there is provided an image processing apparatus for outputting an indexprint of information representing a plurality of images, whichcomprises: input means for inputting the plurality of images to whichnumbers are respectively assigned; means for detecting size informationon image sizes of the plurality of images; decision means fordetermining an outputting order, which is different from a numericalorder determined by the numbers respectively assigned to the pluralityof images, according to the size information on image sizes of theplurality of images; and output means for outputting the plurality ofimages according to the outputting order. Thus, an image processingapparatus for laying out a plurality of pictures of different sizes canobtain an index print, which excels in the indexing ability and has agood or fine appearance, without making a useless or wasteful space onthe printing paper.

[0062] Although the preferred embodiments of the present invention havebeen described above, it should be understood that the present inventionis not limited thereto and that other modifications will be apparent tothose skilled in the art without departing from the spirit of theinvention.

[0063] The scope of the present invention, therefore, is to bedetermined solely by the appended claims.

What is claimed is:
 1. An image processing apparatus for outputting anindex print of information representing a plurality of images,comprising: input means for inputting the plurality of images to whichnumbers are respectively assigned according to a numerical order; meansfor detecting size information for each of the plurality of images basedon respective image size; decision means for determining an outputtingorder, which is different from the assigned numerical order, accordingto the detected size information for each of the plurality of images;and output means for outputting the plurality of images according to thedetermined outputting order.
 2. The image processing apparatus accordingto claim 1 , wherein said output means is a printer for printing data onprinting paper.
 3. The image processing apparatus according to claim 2 ,wherein said output means is an ink-jet printer.
 4. The image processingapparatus according to claim 1 , wherein said output means outputs theplurality of images onto a recording medium in a manner that theplurality of images are arranged in the assigned numerical order.
 5. Theimage processing apparatus according to one of claims 1 to 4 , whereinsaid input means is a digital camera.
 6. The image processing apparatusaccording to claim 1 , wherein said size information relates to anaspect ratio.
 7. An image processing method for outputting an indexprint of information representing a plurality of images, comprising: adetection step of detecting size information for each image based onimage size of each of the plurality of images to which numbers arerespectively assigned according to a numerical order; and a decisionstep of determining an outputting order, which is different from theassigned numerical order, according to the detected size information foreach of the plurality of images.
 8. The image processing methodaccording to claim 7 , which further comprises an output step ofoutputting the plurality of images according to the determinedoutputting order.
 9. The image processing method according to claim 8 ,wherein the plurality of images, which are outputted, are printed by aprinter on printing paper.
 10. The image processing method according toclaim 9 , wherein said output means is an ink-jet printer.
 11. The imageprocessing method according to claim 7 , wherein the plurality of imagesare outputted in said output step onto a recording medium in a mannerthat the plurality of images are arranged in the assigned numericalorder.
 12. The image processing method according to claim 7 , whichfurther comprises an input step of inputting the plurality of images.13. The image processing method according to claim 12 , wherein theplurality of images are inputted by a digital camera in said input step.14. The image processing method according to claim 7 , wherein said sizeinformation relates to an aspect ratio.
 15. A storage medium storing aprogram for causing a computer to output an index print of informationrepresenting a plurality of images, wherein said program causes inputmeans to input the plurality of images, to which numbers arerespectively assigned according to a numerical order, to said computer,wherein said program then causes said computer to detect sizeinformation for each of the plurality of images based on respectiveimage size, wherein said program subsequently causes said computer todetermine an outputting order, which is different from the assignednumerical order, according to the detected size information for each ofthe plurality of images, and wherein said program then causes outputmeans to output the plurality of images according to the determinedoutputting order.
 16. The storage medium storing a program according toclaim 15 , wherein said output means outputs the plurality of imagesonto a recording medium in a manner that the plurality of images arearranged in the assigned numerical order.
 17. The storage medium storinga program according to claim 15 , wherein said size information relatesto an aspect ratio.
 18. A storage medium storing a program for causing acomputer to output an index print of information representing aplurality of images, wherein said program causes said computer to detectsize information for each image based on image size of each of theplurality of images and to determine an outputting order, which isdifferent from a numerical order determined by numbers respectivelyassigned to each of the plurality of images, according to the detectedsize information for each of the plurality of images.